SDN-enabled Resource Provisioning Framework for Geo-Distributed Streaming Analytics
نویسندگان
چکیده
Geographically distributed (geo-distributed) datacenters for stream data processing typically comprise multiple edges and core connected through Wide-Area Network (WAN) with a master node responsible allocating tasks to worker nodes. Since WAN links significantly impact the performance of task execution, existing assignment approach is unsuitable low latency high throughput demand. In this paper, we propose SAFA, resource provisioning framework using Software-Defined Networking (SDN) concept an SDN controller monitoring WAN, selecting appropriate subset nodes, assigning designated We implemented plane in P4 control components Python. tested proposed system on Apache Spark, Storm, Flink Yahoo! streaming benchmark set custom topologies. The results experiments validate that viable confirm it can improve at least 1.64× time incoming events current systems.
منابع مشابه
A GIS-enabled Distributed Simulation Framework for Natural Resource Management
A distributed simulation framework is presented to enable natural resource managers to take advantage of both Geographic Information System (GIS) functionality and computationally intensive ecological modeling. Based on one of the newest products from a major vendor of GIS software (ESRI’s ArcGIS engine), a user interface was developed to manipulate and visualize digital maps and spatially expl...
متن کاملBohr: Similarity Aware Geo-distributed Data Analytics
We propose Bohr, a similarity aware geo-distributed data analytics system that minimizes query completion time. The key idea is to exploit similarity between data in different data centers (DCs), and transfer similar data from the bottleneck DC to other sites with more WAN bandwidth. Though these sites have more input data to process, these data are more similar and can be more efficiently aggr...
متن کاملDiAl: Distributed Streaming Analytics Anywhere, Anytime
Connected devices are expected to grow to 50 billion in 2020. Through our industrial partners and their use cases, we validated the importance of inflight data processing to produce results with low latency, in particular local and global data analytics capabilities. In order to cope with the scalability challenges posed by distributed streaming analytics scenarios, we propose two new technolog...
متن کاملWANalytics: Analytics for a Geo-Distributed Data-Intensive World
Large organizations today operate data centers around the globe where massive amounts of data are produced and consumed by local users. Despite their geographically diverse origin, such data must be analyzed/mined as a whole. We call the problem of supporting rich DAGs of computation across geographically distributed data Wide-Area Big-Data (WABD). To the best of our knowledge, WABD is not supp...
متن کاملA new SDN-based framework for wireless local area networks
Nowadays wireless networks are becoming important in personal and public communication andgrowing very rapidly. Similarly, Software Dened Network (SDN) is an emerging approach to over-come challenges of traditional networks. In this paper, a new SDN-based framework is proposedto ne-grained control of 802.11 Wireless LANs. This work describes the benets of programmableAcc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Transactions on Internet Technology
سال: 2023
ISSN: ['1533-5399', '1557-6051']
DOI: https://doi.org/10.1145/3571158